Physics behind the minimum of relative entropy measures for correlations 
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The relative entropy of a correlated state and an uncorrelated reference state is a reasonable 
measure for the degree of correlations. A key question is however which uncorrelated state to 
compare to. The relative entropy becomes minimal for the uncorrelated reference state that has 
the same one-particle density matrix as the correlated state. Hence, this particular measure, coined 
nonfreeness, is unique and reasonable. We demonstrate that for relevant physical situations, such 
as finite temperatures or a correlation enhanced orbital splitting, other choices of the uncorrelated 
state, even educated guesses, overestimate correlations. 
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Correlated electrons give rise to fascinating physics 
such as quantum criticalityi, Mott-Hubbard transitions^, 
or spin-fluctuations^ e.g. in high-temperature supercon- 
ductors. However, correlations are particularly difficult 
to deal with in theory and even a universally agreed 
definition, or measure, of "correlation" is hitherto lack- 
ing. There is a general agreement that a Hartree-Fock 
Slater determinant represents an uncorrelated state, even 
though such a wave function includes formally something 
one might call "correlations", which originate from the 
antisymmetrization of the wave function. Hence a cor- 
relation measure typically considers the difference of the 
correlated state vs. an uncorrelated Hartree-Fock calcu- 
lation. In this situation, the questions are: For what 
quantity should one consider the difference? To which 
uncorrelated (possibly mixed) state should one compare 
to? 

One possibility to quantify correlation is to look at the 
energy difference 



E r 



(1) 



between the (correlated) state investigated (E corr ) and 
an uncorrelated (or free) state £f ree , which is also coined 
correlation energy. This is e.g. the typical quantity con- 
sidered in quantum chemistry or density functional the- 
ory (DFT)£~— . The exchange-correlation energy E xc is, 
as the difference to the Hartrcc energy, also readily acces- 
sible in DFT, at least within e.g. the local density approx- 
imation (LDA). This requires, however, still a separation 
into exchange and correlation part. 

In many-body theory on the other hand, one often con- 
siders two particle correlation functions of the type 7 - 

Cm = (44 c k c l)- «ch><cK) - <clc fe )(cj Ci )), (2) 

where, c\ (c i ) is the creation (annihilation) operator for 
a particle in the one-particle state i (subsuming a possi- 
ble spin index). The second and third term subtract the 
uncorrelated expectation value. That is a Slater deter- 
minant would yield as a result of the first term, the latter 
two terms because of Wick's theorem 7 - so that C^ki = 0. 



Hence, we will consider a state with Cy/y 7^ as "corre- 
lated" in the following. The problem with Eq. © as a 
correlation measure is that there is a myriad of such cor- 
relation functions - not only the two-particle correlation 
functions of Eq. ([2]) but also n-particle generalizations 
thereof. Even for a "highly correlated" state some of the 
correlation functions can be small, even smaller than for 
what one would consider a "weakly correlated" state. 

Based on ideas from statistical or information the- 
ory, correlation measures have been proposed which are 
based on the 1-particle density matrix (1PDM) or its 
eigenvalues £~— In Refs. [l6lfT7l these concepts were ex- 
tended to mixed states, which requires the full density 
matrix instead of the 1PDM. The resulting measure of 
correlation entropy, called "nonfreeness,"— is for a pure 
state equivalent to the particle-hole symmetric correla- 
tion entropy introduced in Ref. [111. Beyond this, also 
mixed states such as thermal ensembles or open subsys- 
tems can be treated. Such systems cannot be treated by 
a single Slater determinant but behave as a "mixture" of 
pure states, best represented by the full density operator. 

The basic idea behind nonfreeness is that a many- 
body state which has the form of a grand canonical ther- 
mal equilibrium ensemble of non- interacting particles has 
zero correlation. Such a non-interacting state is called 
"free" in Ref. [13 and has C ijki = in Eq. ©. Free 
states include all Slater determinant wavefunctions but 
also mixed states whose density operators satisfy a gener- 
alization of the (finite-temperature) Hatree-Fock ansatz. 

For a many-electron state with density matrix p, there 
exists a unique free state T 7 that has the same 1PDM 
7 P as p. With this jo, Ref. defines as "nonfreeness" 
the relative entropj*^ 



<t(p) = -TrfplogF 



1p) 



Tr(plogp) 



(3) 



Recently, the use of relative entropy has also been pro- 
posed in Ref. Ojl as a measure of correlations . Here, cor- 
relations are quantified by the entropy relative to phys- 
ically motivated uncorrelated reference states with den- 
sity matrix r re f asi^ 



S(p\T r 



-Tr^loglW) +Tr(plogp) 



(4) 
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This measure has been applied^ to the Hubbard model, 
MnO, FeO, CoO and NiO. As examples for the reference 
states r re f, the paramagnetic, antifcrromagnctic or LDA 
Slater determinants^ were taken (restricted to a single 
site subsystem). Obviously, there is an ambiguity which 
physically motivated reference state to choose. Hence, 
Ref. [l^ proposes to minimize the relative entropy, which 
was however considered a too hard computational prob- 
lem. 

Obviously, £(p) is the relative entropy for a particular 
reference state, i.e., €(p) = S(p\T lp ). It has been proven 
recently 2 ^ that the nonfreeness is indeed the minimum 
over all free reference states r re f , which are uncorrelatcd 
in the sense that Cijki = in Eq. ([2]): 

€{p) = S{p\T lp ) = min5(p|r rcf ). (5) 

1 rel 

In this paper, we argue that this minimal relative en- 
tropy is also most reasonable from a physical point of 
view: Its reference state T lp has the same 1PDM, i.e., 

all one-particle expectation values {c\cj) are the same. 
From this 1PDM and Wick's theorem for an uncorre- 
lated state with Cijki = 0, all correlation functions and 
hence the full density matrix L 7p can be calculated, see 
Appendix. Let us also emphasize, that nonfreeness £(p) 
defines this way a unique relative entropy measure of cor- 
relations. Obviously, it measures correlations of a state 
with given density matrix p, but not how correlated a 
Hamiltonian is. This is reasonable if we want to quan- 
tify the correlations of a (mixed) state, independently on 
whether this is e.g. the groundstate of one Hamiltonian 
or the non-equilibrium state of another Hamiltonian. 

Let us now discuss two physical examples, where even 
a well educated choice of the uncorrected reference state 
leads to an overestimation of "correlation" compared to 
the corresponding non-free state. 

(i) Finite temperatures. Let us assume we have, 
for example, an antiferromagnet. Here one might be in- 
clined to take an antifcrromagnctic Slater determinant 
such as the ground state of a Hartrce-Fock calculation 
for the same Hamiltonian as reference state. However, at 
finite temperatures the antiferromagnetic magnetization 
is reduced. Hence, if we employ the relative entropy Eq. 
(UJ between this finite-temperature Hartree-Fock solution 
and the antiferromagnetic zero-temperature Slater deter- 
minant, it is finite. That is, Eq. Q indicates the presence 
of correlations in a situation were there are none, in the 
sense that all Cijki = 0. In contrast, the nonfreeness 
measure employs in this situation the very same finite- 
temperature Hartree-Fock state as a reference state and 
is hence zero. 

Even if we consider a single Slater determinant with 
the correct (here finite-temperature Hartree-Fock) mag- 
netization, its density matrix is different from that of 
the finite temperature Hartree-Fock calculations which 
represents a thermal ensemble of Slater determinants. 
Hence, according to Eq. Q we would, even with a more 
well educated guess for the reference state, call the finitc- 



tcmpcraturc Hartree-Fock state correlated. 

If truly correlated states are considered, the situa- 
tion becomes more complicated, but the nonfreeness war- 
ranties that we compare to a reference state which has 
the correct, finite temperature magnetization and which 
is an uncorrelated ensemble being more general than a 
single Slater determinant. This free reference state is as 
close to the correlated state as possible: it has the same 
1PDM and from requiring Cijki = in Eq. (0| and its 
iV-particlc generalizations follows the full density matrix. 

(ii) Orbital splitting. Let us as a second example 
consider a typical solid state situation. There are orbitals 
which are split by a one-particle crystal field. This crystal 
field as well as the hopping between different sites can be 
calculated for example by LDA. 

As a specific example, we will take a LaNiOa/LaAlOs 
heterostructure for which the low-energy non-interacting 
LDA Hamiltonian is explicitly given in Ref. I22I . Since 
Ni has an open d-shcll with, on average, one electron in 
two e g orbitals, there is a strong Coulomb interaction for 
the case that there is a second electron in the e g orbitals 
on the same site. As a consequence, strong electronic 
correlations can emerge. These have been calculated in 
Refs. [21II22I employing the LDA + dynamical mean field 
theory (DMFT) approach^^ 

In LDA there are somewhat more x 2 — y 2 than 3z 2 — r 2 
electrons. We express this by the one-particle occupa- 
tions: ni = 0.376 for each spin compared to n 2 = 0.124, 22 
where 1 and 2 denote the x 2 — y 2 and 3z 2 — r 2 orbital, re- 
spectively, and 7ii,ri2 is the same for spin- up and -down 
in the paramagnetic phase considered. This results in the 
1PDM 

fm \ 

V nj 

which is diagonal for the given Hamiltonian. 

If the Coulomb interaction U (and Hund's exchange 
J) is taken into account, the effective crystal field split- 
ting between the two orbitals is enhanced 2 ^. While the 
increased orbital splitting is an effect of U it does not nec- 
essarily imply a correlated state. In fact, such physics can 
already be described in an uncorrelated Hartree-Fock (or 
LDA+U^I) calculation, where the splitting is enhanced 
by U (rii — 712) . For the LDA+U solution, we have a free 
state with zero nonfreeness, whereas the relative entropy 
to the U — Slater determinant as reference state would 
be finite. 

Also for a truly correlated state, obtained e.g. from 
a LDA+DMFT calculation, we will get an enhanced 
effective crystal field splitting and different orbital oc- 
cupations: for U = 5.8 cV and inverse temperature 
j3 = 25 cV -1 the orbital occupation changes dramatically 
to ni = 0.48835 and n 2 = 0.01200.-2 2 - Such a change could 
be the result of a completely uncorrelated, e.g. LDA+U, 
wave function or due to true electronic correlations. 
Equal-time two-particle correlations can be described by 



3 



pair-wise double occupations dij = (cj^ctc^.) with the 
index i subsuming the orbital and spin, more specifically 
the correlation is given by the difference dij — riiTij, sec 
Eq. ©. 

In Ref. [22| the pairwise double occupations have been 
calculated. For U = 5.8 eV and inverse temperature (3 = 
25 eV- 1 one has e.g.: d im = 0.01014, d 2n i = 0.00003, 
d im = d 2fU = 0.00317, di t2t = d un = 0.00452. If we 
neglect occupations with three or four electrons on a site 
(which arc extremely rare for larger U), we obtain from 
the pairwise double occupations and orbital occupations 
the local density matrix for a single site: 



\ 



"l 



n 2 



difii 

^14.24. 

d2\2y 



0000) 
1000) 
0100) 
0010) 
0001) 
1100) 
1010) 
1001) 
0110) 
0101) 
<- 10011) 

|ltU2t2|L) 



Here, the right hand side indicates the meaning of the in- 
dividual rows (and columns) of the density matrix, using 
an occupation number formalism with states as indicated 
in the last line. Note that the symmetry of the Hamilto- 
nian yields a purely diagonal density matrix in our case. 
For the one-particle sector of the density matrix, we need 
to subtract from the average occupation number all dou- 
ble occupations which involve the given orbital and spin 
for obtaining the single particle occupation of this state, 
i.e., hi = m— difi±— dif2fdif2i and equivalently (1 «-> 2) 
for hi- The zero occupation sector is given by the sum 
rule (neglecting occupations with three or four electrons): 
ri0 = 1— 27?i— 2n 2 — di-t-i4,~d2t24,~^it2^— ^it2t — ^ii2t~^i^2j,- 
For this local density matrix, we have calculated as 
outlined in the Appendix the relative entropy Eq. (U) 
vs. (i) the uncorrelatcd U = state which is defined by 
its one particle density matrix Eq. ([6]) and (ii) the free 
state with the same 1PDM as the LDA+DMFT corre- 
lated state. The latter relative entropy is the nonfree- 
ness. 

Fig. Q] shows the obtained relative entropy in the vicin- 
ity of the Mott-Hubbard metal insulator transition. In 
this parameter regime, double occupations are further 
suppressed so that electronic correlations are enhanced. 
This can be seen in the nonfreeness measure. The relative 
entropy against the U = state increases however even 
more strongly. This additional increase is not caused by a 
correlated wave function or density matrix but by a shift 
in the occupation of the orbitals which can be described 
in an uncorrelated state as well. 

Conclusion and Outlook. Recently, there has been 
a growing interest in the density matrix based measures 
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FIG. 1: (Color online) Relative entropy vs. Coulomb inter- 
action U of the correlated DMFT state of LaNi0 3 /LaA10 3 
against (i) the uncorrelated (7 = state and (ii) the uncorre- 
lated state with the same 1PDM (nonfreeness). 



of electronic corrclation o 17 ' 19 ' 28 ' 29 . To this end, the en- 
tropy of the correlated state, which is described by its 
density matrix, has been compared to different reference 
states. The relative entropy is minimal for a particular 
uncorrelated ("free") state: the one that has the same 
1PDM and, hence, the same occupations of the (natural) 
orbitals. This measure is unique and coined "nonfree- 
ness" . If one compares to other uncorrelated reference 
states one gets a higher entropy measure of correlation. 
This difference simply stems from a different orbital occu- 
pation which does not necessitate true correlations, i.e., 
nonzero correlation functions C^ki i= 0. 

As illustrating example we have considered finite 
temperatures and a two-orbital LaNiOs/LaMnOa het- 
erostructure. In this material, the Coulomb interaction 
U changes (among others) the orbital occupations, effec- 
tively enhancing the crystal field splitting between the 
two orbitals. However, such a change of the orbital occu- 
pations does not require a correlated state. Indeed also a 
Hartree-Fock or LDA+U state shows this kind of physics. 
For this finite-?/ Hartree-Fock state all correlation func- 
tions, such as those of Eq. @, are zero, while the relative 
entropy with the U = state as a reference state would 
suggest correlations. 

Hence, we feel that the nonfreeness is the most suit- 
able relative entropy measure for electronic correlations if 
these are defined as corresponding to nonzero correlation 
functions Cijki in Eq. ([2]), which is actually a usual defini- 
tion for correlations in solid state theory: Any state with 
Cijki = and iV-particlc generalizations thereof has zero 
nonfreeness. Nonfreeness does however not distinguish 
between genuine quantum correlations and classical ones, 
which have been individuated in Ref. I29I . For example in 
the paramagnetic phase, the single-site-reduced density 
matrix p of the one-band Hubbard model for half-filling 
and double occupation d and the free state T 7p with the 
same 1PDM are (in the single-site spin-up/-down basis 
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as indicated on the right hand side) 
( 



l-2d 
2 



V 



1-2 d 
2 
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1 1 
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|00) 
|10> 
|01) 

111) 



(7) 



For U — > oo, we have d — >• and so that the nonfrecness 
becomes €(p) = — log(l/4) +log(l/2). However, there 
are no genuine quantum correlations in the atomic limit. 
We can describe this state as a classical ensemble with 
50% probability of a spin-up and -down occupation. 
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Appendix. Let us add here some useful relations for 
the practical calculation of relative entropies. Let us con- 
sider the Lowdin natural orbital^ basis where the 1PDM 
is diagonal and the entries of the 1PDM are simply the 
probabilities pi = (cjc^) for the occupation of orbital 



i. For an uncorrelatcd or free state Ff re( 
termine, because of Cijki = in Eq. (Q| 



these p^s de- 
all correlated 

expectation values such as (clcjC^^ and hence also the 
full density matrix rf ree . In a many-particle occupation- 
number basis \n\---n n ) with rii G {0,1} denoting the 
occupation of the Lowdin natural orbital i, the free den- 
sity matrix Ff roe is also diagonal with diagonal elements^ 
nr=i^r i (l ~ Pi) 1 ~ ni ■ That is, we simply have the prod- 
uct of the probabilities to occupy or not to occupy orbital 
i. 

For such a Ff roc , — Tr{plogrf roo } can be calculated and 
shown to be minimal^ for rf roc 



7 P ) 



i.e., the uncor- 



relatcd free state with the same 1PDM as p. 
minimum, one obtains^ 



For this 



- Tr{p log r 7p } = - J2 Pi Iog(Pi) - J2 ( 1 - Pi ) lo S( 1 - Pi ) 

i i 

(8) 

so that the nonfreeness €(p) in Eq. ^ can be easily cal- 
culated for a given density matrix p. 
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